ON IDEMPOTENT ULTRAFILTERS IN HIGHER-ORDER 
REVERSE MATHEMATICS 



ALEXANDER P. KREUZER 

Abstract. We analyze the strength of the existence of idempotent ultrafilters 
in higher-order reverse mathematics. 
^ 1 Let (Widem) be the statement that an idempotent ultrafilter on N exists. 

We show that over ACAq , the higher-order extension of ACAo, the statement 
(^idcm) implies the iterated Hindman's theorem (IHT), as introduced by Hirst, 
(^idem) is flj -conservative over ACAg + IHT. 



In [15] we developed a technique to extract programs of proofs using non-principal 
ultrafilters. Along these lines we also proved a conservativity results for the state- 
ment that a non-principal ultrafilter exists. 

In this paper we apply these techniques to idempotent ultrafilters. Roughly, we 
will show that the existence of idempotent ultrafilters is Ll^-conservative over the 
iterated Hindman's theorem (IHT) as defined by Hirst in [pj. 

Let (IA), (Uidcm) be the statement that a non-principal resp. idempotent non- 
principal ultrafilter on N exists. Let RCAq , ACAq be the extensions of RCAo resp. 
ACAo t° higher-order arithmetic as introduced by Kohlenbach in ,13j. In RCAq 
or ACAq the statements (It), (Uidcm) can be formalized using an object of type 
N N — > N. 

Further, let Feferman's \i be a functional of type N N — > N satisfying 

/(/*(/))= if 3xf(x) = 

and let (//) be the statement that such a functional exists. It is clear that (/i) 
implies arithmetical comprehension. However, \x is not definable in ACAg . 
In [T5] we showed that 

• RCAq h (It) -►(/*) and that 

• ACAq + (fi) + (14) is n^-conservative over ACAq. Moreover, we proved a 
program extraction results for this system. 

The purpose of this paper is to analyze (Widem) m the same way. We obtain 

• RCAq h (Widom) -Km) A IHT, see TheoremEl and 

• ACA^ + (/x) + IHT + (Widcm) is n^-conservative over ACA^ + IHT, see The- 
orem [7] We also obtain a program extraction result for this system. 

There are many theorems from combinatorics and Ergodic theory which are estab- 
lished using idempotent ultrafilter, see for instance [H1I2]- Our result provides a 
method to eliminate the use of idempotent ultrafilters and to extract constructive 
content of such proofs. 
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1. Logical Systems 

We will work in fragments of Peano arithmetic in all finite types. The set of all 
finite types T is defined to be the smallest set that satisfies 

OeT, p,r 6 T => r(p) £ T. 

The type denotes the type of natural numbers and the type r(p) denotes the type 
of functions from p to r. The type 0(0) is abbreviated by f the type 0(0(0)) by 2. 
The degree of a type is defined by 

deg(0) := deg(r(p)) := max(deg(r), deg(p) + 1). 

The type of a variable will sometimes be written as superscript of a term. 

Equality =o for type objects will be added as a primitive notion to the systems 
together with the usual equality axioms. Higher type equality = Tp will be treated 
as abbreviation: 

x Tp = Tp y Tp := \fz p xz = T yz. 

Define the A-combinators n p(T , S p (TjT for p. a, t £ T to be the functionals satis- 
fying 

^p,aX p y a —p x, Yi p ^ a ^ T x Tcrp y ap z p = T xz(yz). 
Similar define the recursor R p of type p to be the functional satisfying 

RpOyz = p y, R p (Sx°)yz = p z(R p xyz)x. 

Let Godel's system T be the T-sorted set of closed terms that can be build up 
from 0°, the successor function S , the A-combinators and the recursors R p for 
all finite types p. Using the A-combinators one easily sees that T is closed under 
A-abstraction, see [IB]. Denote by To and T\ the fragments of Godel's system T, 
where primitive recursion is restricted to recursors Rq resp. Rq and R\. The system 
To corresponds to the extension of Kleene's primitive recursive functionals to mixed 
types, see jllj . whereas full system T corresponds to Godel's primitive recursive 
functionals, see [BJ. By Tq[F] we will denote the system resulting from adding a 
function(al) F to T . 

The system RCAq is defined to be the extension of the term system To by 
E^-induction, the extensionality axioms 

(E p , T ) : Mz Tp , x p , y p (x = p y -4 zx = T zy) 

for all t, p £ T, and the schema of quantifier free choice restricted to choice of 
numbers over functions (QF-AC 1 ' ), i.e. 

V/ 1 3x° Agf(f, x) -> 3F 2 V/ 1 V/, F(f)). 

This schema is the higher-order equivalent to recursive comprehension (A^-CA). 
(Strictly speaking the system RCAg was defined in [T3] to contain only quantifier free 
induction instead of E^-induction. Since Ej'-induction is provable in that system, we 
may also add it directly.) The systems WKLg , ACA^ are defined to be RCA^ + WKL 
resp. RCAq + n?-CA. 

All of these systems are conservative over their second-order counterparts, where 
the second-order part is given by functions instead of sets. These second-order 
systems can then be interpreted in RCA , resp. WKL , ACA . See [T5] , 

We will also use the following result by Hunter. 

Theorem 1 (10, Theorem 2.5]). The system RCAq + (p) is conservative over 
ACA . 
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Note that the result is proven using a model construction and does not provide 
any method which would translate a proof of an analytic statement in RCAq + (/i) 
to a proof in ACAo. However, for Il^-statements there is such a method, see [TJ 
Theorem 8.3.4] and [5]. 

The system RCAq has a functional interpretation (always combined with the 
elimination of extensionality and a negative translation) in To. The system ACAq 
has a functional interpretation in To [/z] , see P~3J HI E] ■ 

Definition 2 (idempotent non-principal ultrafilter, (Z^dcm))- Let (Mdcm) be the 
statement that there exists an idempotent non-principal ultrafilter (on N): 

' 3U 2 (yx (x eU \/x eU) 

AVX^Y 1 (X r\Y eU^Y eU) 
> avi 1 ^ 1 (i,rew^(inr)ew) 

(Widcm) : \ , 

AVX 1 (X e U^~in3k > n(k e X)) 

AVX 1 (XeU^{neN\X-neU}eU) 

A VX 1 (U(X) = sg(U(X)) = U(Xn. sg(X(n)))) ) 

Here X € U is an abbreviation for U{X) =o 0. The type 1 variables X, Y arc 
viewed as characteristic functions of sets, where n e X is defined to be X(n) = 0. 
The operation n is defined as taking the pointwise maximum of the characteristic 
functions. With this, the intersection of two sets can be expressed in a quantifier 
free way. The last line of the definition states that U yields the same value for 
different characteristic functions of the same set and that U{X) < 1. 

For notational ease we will usually add a Skolem constant U and denote this also 

with (Widero)- 

The second line in the definition of (Widom) is equivalent to the following axiom 
usually found in the axiomatization of (ultra)filters: 

yx,Y (X CY AX eU^Y eU). 

We avoided this statement in (Uidcm) since C cannot be expressed in a quantifier 
free way. 



2. Iterated Hindman's theorem 

Let X be an infinite set of natural numbers and (xj)j be a strictly ascending 
enumeration of it. We will write 

FS(X) = FS((xi)i) := { x h + ■ ■ ■ + Xi J h < i 2 < ■ ■ ■ < i k } 

for the set of finite sums of X. 

Definition 3 (|7J). Hindman's theorem (HT) is the statement that for each coloring 
c: N — > 2 of the natural numbers there exists an infinite set X such that FS(JT) 
is homogeneous for c. 

For Hindman's theorem it is known that it implies ACAo and is implied by ACA^ 
that is ACAo phis the statement that for each set X the w-Turing jump X^ exists, 
see [1]. It is an open problem to determine the exact logical strength of HT, see 
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Deflnition 4 ( 9 ). Iterated Hindman's theorem (IHT) is the statement that for 
each sequence of colorings Ck ■ N — > 2 there exists an ascending sequence (xj)jgN 
such that for each k the set FS((i£i)°^ fe ) is homogeneous for c^. 

Theorem 5 (RCA ). 

(i) Hindman's theorem is equivalent to the statement that for each infinite set 
Y and for each coloring c: FS(K) — > 2 there exists an infinite subset 
X C FS(T) such that FS(X) is homogeneous for c. 
(ii) Similarly, iterated Hindman's theorem is equivalent to the statement that 
for each infinite set Y and for each sequence of colorings c^ : FS(Y") — > 2 
there exists a sequence (#i)i£N C FS(V) which satisfies the conclusion of 
IHT. 



Proof, (i) follows from Lemma 2.1 of [3J, see also [2J, and noting that the proof of 



the equivalences formalizes in RCAq. (ii) follows by iterating the construction of 



m n 

Theorem 6. RCAq h (U id em,) -> IHT 

Proof. By noting that an idempotent non-principal ultrafilter is an almost down- 
ward translation ultrafilter, in the sense of [5] , for any countable almost translation 
algebra we see that this theorem follows from Theorem 3 of [5] . □ 

The main results of this paper are the following theorems. 

Theorem 7. The system ACAq + (/i) + IHT + (Uidem) is H^- conservative over 
ACA£ + IHT. 

Along the same lines, we can prove the following program extraction result. 
Theorem 8 (program extraction). Let Mf 3g A(/, g) be a sentence. If 

ACA£ + in) + IHT + (U idem ) h V/ 3g A(f, g) 
then one can extract from a proof a term t G T\ [fj] such that 

Vf3gA(f,tf). 

Theorem [7] is optimal in the sense that (Widcm) cannot be n^-conservative over 
any system not containing IHT because of Theorem [S] The program extraction of 
Theorem [8] is not faithful. For type reason (Widcm) does not imply the totality of 
R\. However, we do not have a faithful functional interpretation for IHT yet and 
just use R\ and \i to emulate ACAj. 

The proofs of these theorems are similar to the proof of Theorem 4 in [15] . They 
proceed roughly in the following steps. 

(1) Let V/ 3g A(/, g) be a n^-statement such that 

ACA£ + ( M ) + IHT + (Uidem) r- V/ 3g A(f, g). 

Using the functional interpretation and a program normalization we show 
that each application of U in this proof is of the form U(t[n ]) for a term t 
that contains only n free and with Xn.t £ Tb[W]. (This step does not differ 
from the first step in [T5].) 

(2) We now construct provably in RCAq + (//) + IHT a — so called — downward 
translation partial ultrafilter, which acts like an idempotent ultrafilter on 
the sets that occur in the proof. The idempotent ultrafilter is then replaced 
by this object in the proof. 
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(3) Applying Theorem Q] to this yields Theorem 

(4) For Theorem [8] we notice that in Ti[/j] we can define a functional solving 
IHT and thus we can explicitly describe the downward translation partial 
ultrafilter we construction in the second step. With this we get a program 
witnessing g. 



In [15] we built a — so called — partial non-principal ultrafilter which acted on 
the algebra of sets that were used in a proof like a non- principal ultrafilter. We 
will now briefly recall the notions of algebra and partial non-principal ultrafilter. 
After this, we will introduce the notions of downward translation algebra and down- 
ward translation partial ultrafilter which will be suitable for handling idempotent 
ultrafilters. 

Definition 9. 

• An algebra is a set A C V(N) of subsets of natural numbers, that is closed 
under complement, finite unions and finite intersection. 

• For an algebra A we call a set JF a partial non-principal ultrafilter for A if 
T satisfies the axioms for a non-principal ultrafilter relativized to A, i.e. 



AVX e A {X e F^Vn3k > nk e X) 

k AVX 1 (J-(X) = sg(J-(X)) =o J-(An.sg(X(n))) . 

(Note that we do not require J 7 to be a subset of A as we did in [TB] . This 
restriction was actually not used in [15j and could have been omitted.) 

Definition 10. 

• An algebra A is called downward translation algebra if it is closed under 
downward translations, i.e. 



• A downward translation partial ultrafilter is a partial non-principal filter T 
for a downward translation algebra A which in addition to (TT]) satisfies the 
following axiom 



Note that we do not require the set {n € N | X — n 6 J 7 } to be in the alge- 
bra A. 

In other words, a downward translation partial ultrafilter for A is an 
object which satisfies the axioms (Widem) but where X, Y is restricted to A. 

Like in [15j we will mostly work with countable downward translation algebras 
A which are given by a sequence of sets (^4i)i e N- The characteristic function of \A 
of A is then given by 



3. Downward translation partial ultrafilter 



(1) 



' Vlei(XeJvIeJ) 
AVX,Y eA(xnYe T^Y e F) 
< avx,f e A (x,Y e T^{x nY) e F) 



X ei^VneN (X -ne A). 



(2) 



MX e T ({n eN|l-neJ}eJ). 





1 otherwise. 
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Such a characteristic function can be defined using fi. 

It is easy to see that in RCAq each sequence of sets (Ai)i can be extended to 
form a countable downward translation algebra. 

The partial filters we will build will be of the following form 



where {x{)i is a strictly ascending sequence of natural numbers. 

One checks that F{(xi)i) is closed under finite intersections, supersets and con- 
tains only infinite sets. Thus, it is a filter. 

Lemma 11. Let (xj), be an ascending sequence of natural numbers. Then T((xi)i) 
satisfies 

In particular, if J-{{xi)i) is a partial non-principal ultrafilter for a downward 
translation algebra A then it is already a downward translation partial ultrafilter for 



Proof. Let X 6 T{(xi)i). By definition there is an m, such that FS((xi)^ m ) C X. 

It is sufficient to show that FS((xi)?l m ) C {n 6 N | X - n e or in 

other words that for each n <E FS((xi)°^ m ) we have X-ii£ F{{xi)i). 

Indeed each such n can be written as n = Xi t + Xj 2 + • ■ ■ + Xi k for distinct 
H) • • • , ik > rn. Let now I := maxjii, . . . , ik} + 1. Then for each n' G FS((x.i)°^ ; ) 
the number n' + n is an element of FS((a:,)?5. m ) or in other words FS((xj)?^i) C 
FS((x l )^ m ) - n. Thus, FS((x l )£ ; ) CX-n, with this X -ne J r ((a; J ) J ), and the 
lemma follows. □ 

Lemma 12. Let A be a downward translation algebra. If for a sequence {xi)i the 
set T{{xi)i) is a downward translation partial ultrafilter for A then for any sequence 
(Vi)i Q FS{{x t )i) we have F{{x l ) i ) f)A= J r ((y l ) l ) n A. 

Proof. By definition of T((xi)i) we have that F{{xi)i) C J-((yi)i). Moreover, the 
set JF((yi)i) is a filter and, therefore, contains for each X at most one of X and X. 
Now F((xi)i) is maximal in A in the sense that for each X £ A either X or X is 
an element in F{{xi)i). Thus, both filters must be equal on A. □ 

Theorem 13. Let A be a countable downward translation algebra and let (xi)i 
be a sequence such that F((xi)i) is a downward translation partial ultrafilter for A. 
Then RCAq + (/i) + IHT proves that for each countable downward translation algebra 
A = (Ai)i e ^ D A there exists a sequence (yi)i C FS((xi)i) ; such that J-{{yi)i) is a 
downward translation partial ultrafilter for A. 

In particular, J r ({y l ) l ) D F{{xi)i) and F((yi)i) nA = IF((Xi)i) n A. 

Proof. Let 



By IHT and Theorem[5]there exists a sequence (yi)i C FS((xj)j) such that FS((yi)°Z k ) 
is homogeneous for Cfc, i.e. FS((yj)™ fe ) is contained in either Ak or Ak. Thus, for 



^((a:,)*) :={XCN 3mF${{x i )™ m ) C X } 



A. 




each k the filter F((yi)i) contains either Ak or Ak and is, therefore, a downward 
translation partial ultrafilter for A. □ 
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Remark 14 (Stone-Cech compactification) . The filter of the form F((xi)) can be 
viewed as the following closed set of the Stone-Cech compactification j3N: 

oo 

Pi {U e PN | FS(( Xi )™ m ) e U} 

The use of such filters/closed sets is inspired by [2J Theorem 2.5] where it is shown 
that such sets contain idempotent ultrafilter. 

4. Proof theory 

We proceed like in [T5]. The elimination of extensionality [TS] Lemma 7] is also 
applicable to (Widem) instead of (U) since 

(Widem) = (U) a yx 1 (XeU^-{ken\X-keU}eU) 

and the added axiom contains only quantification over variable of degree < 1 . There- 
fore, it is not changed by the elimination of extensionality translation. We obtain 
the following lemma. 

Lemma 15 (elimination of extensionality). If A is a sentence that contains only 
quantification over variables of degree < 1 and 

RCAq h (U idem )^A 

then 

WeTa w r + QF-AC 1 ' h (U idem ) -> A. 

Since /x is provably extensional the statement remains true if one adds (/z) to both 
systems. 

We will also use the following term normalization result. 

Theorem 16 (term-normalization for degree 2, fT5j Theorem 8], [HI Q]). Let 
F\, . . . , F n be constants of degree < 2. 

For every term t 1 € To[Fi, . . . , F n ] there is a term t S Tq[Fq, . . . , F n -i] with 

vviTpa" \\-t= x t 

and such that every occurrence of an Fi in t is of the form 

F(io[y },...,i k -i[y }). 
Here k is the arity of Fi, and tj[y ] are fixed terms whose only free variable is y°. 
The axiom (Widem) can be prenexed to the following statement. 
3U 2 VX 1 , Y 1 Vn3k ( VX (leUVle U) 
a (X nY eU^Y eU) 
a (x,y e u^(xnY) eU) 

A (X eU^(k > n A k G X)) 

A(XeU^{neN\X-neU}eU) 

A (U(X) Bg(U(X)) =0 U{\n. sg(X(n)))) ) 

By coding the set X, Y together we obtain the following 
3U 2 VZ 1 Vn 3k {U idcm ) qf (U, Z, n, k) 

where (Widom)?/ is the quantifier free matrix of the above statement. 
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An application of QF-AC 1 ' yields 

(3) 3U 2 3K 2 VZVn {U idcm ) qf (U, Z, n, KnZ) 

The variable K may always be chosen to be the following functional definable 
using n. 

... „. I minifc e X I k > n} if exists, 

(4) K(n,X):=l . 

I otherwise. 

Therefore, the real difficulty is the construction of a suitable hi. 

Proof of Theorem^ Let Vf3gA(f,g) a n^-statement not containing hi or /i and 
provable in ACAq + (/i) + IHT + (U ldcm ). Since (Widem) implies (li), ACA and IHT 
we arrive at 

RCA^ + (Widcm) HV/3 5 A(/,3). 
Using /i one can find quantifier free formula A! q j{f,g), which also does not contain 
hi, such that A(f,g) f-> AL(f,g). Together with the deduction theorem we arrive at 
the following. 

RCA- + (/i) h (W idcm ) -> V/ 3. 9 A^(/, 5 ) 
Applying the elimination of extensionality we get 

W&TV\ W r + QF-AC 1 - + ( M ) h (W idcm ) -y V/ 3. 9 A^(/, </). 
After reintroducing a variable hi for the ultrafilter and using ([3|) we obtain 

(3hi 2 3K 2 VZVn (hi idcm ) qf (hi , Z, n, KnZ)) V/ 3g A' qf {f, g). 
Pulling out the quantifiers we get 

V/ Vhi 2 VA 2 3Z 1 3n 3g (U idem ) qf (U, Z, n, KnZ) -> A' qf {f, g). 
A functional interpretation yields tz,t n ,t g G Tq[u, hi, K, f] such that 

(5) WE^PA" r + (p) H V/ VW 2 VA 2 (U idem ) qf (U, t z ,t n , Kt n t z ) -> A^(/, t fl ). 

Applying Theorem 1161 to tz,t n , t g we obtain terms t' n ,t' g , which are provably 
equal and where every occurrence of W, AT is of the form 

U{t[f]) resp. A(n°,i[j ]) 

forai £T [ ft W,]f, /]. 

Let (U)i <n be the list of all of these terms t to which W and K are applied. 
Assume that this list is partially ordered according to the subterm ordering, i.e. if 
ti is a subterm of tj then i < j. 

We now build for each / a downward translation partial ultrafilter J 7 , which acts 
on these occurrences like a real idempotent non-principal ultrafilter. For this fix an 
arbitrary /. 

The filter T is build by iterated applications of Theorem [T3J We start with the 
trivial downward translation algebra 

A-x := { X C N | X is finite or cofinite } 

and the Frechet filter 

T-x ■= { X C N | X is cofinite} = T{{i) l&H ). 

It is clear that J-—\ is a partial non-principal ultrafilter for A-x- By Lemma 1 1 11 it 
is also a downward translation partial ultrafilter for A-x- 
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Assume now that Ai-i and Ti—i are already defined. Let Ai be the downward 
translation algebra spanned by A-i and the sets described by U where U, K are 
replaced by Fi-i and K' from g]), i.e. (t t [U / K / K']{j)) j&r Let Ti = J 7 ((y l ) l ) 
be the extension of = J-((xi)i) to the new downward translation algebra A4 
as constructed in Theorem [T51 

Since IA is in ti only applied to subterms of f j we obtain by the construction of 
the filter, see Lemma [T21 that 

UlU/Fi-uK/K'] =1 tilU/F^-uK/K'] for all j, / > i 

For the resulting downward translation partial ultrafiltcr J- := T n we obtain 
that 

(WidcmU^", t z [F, K\ f],t n [T, K', f],K't n [F, A", f]t z [F, A', /]). 
In total we get 

RCAq + (/x) + IHT h 

V/ 3T (U idcm ) qf (F, t z [F, K', f],t n [F, K', f],K't n [T, K\ f]t z [T, K', /]). 
Combining this with ([5]) we get 

RC A£ + ( M ) + IHT h V/ 3^ A^(/, t g [ M , T, K, /] ) 

and hence 

(6) RCA^ + ( M ) + IHThV/3 5 A^(/, 5 ). 

Replacing with the equivalent formula A which does not contain /i we obtain 

RCAS + M + IHTI-V/affA(/ >5 ). 
Noting that IHT is analytic and applying Theorem [T] we get 

ACA + IHThV/3 3 A(/, 5 ). 
This proves the theorem. □ 

Proof of Theorem [3 In T\ [/i] one can define a functional which maps a set X to 
its w-Turing jump. Therefore, the functional interpretation of ACA,| can be solved 
in Ti[/z]. Since ACA,| h IHT, we can find a solution of the functional interpretation 
of ©. This implies Theorem M □ 

Concluding remarks. In 17J Towsner also considers ultrafilter in reverse math- 
ematics. He works with second order systems and formalizes the ultrafilter as a 
predicate on the second order sort of the system. The extension of ACA is denoted 
by AC A + 3iX. It is easy to see that AC A + 3il can be embedded into AC Aq + (U) . 
It is not known whether ACAq + (U) is conservative over ACAo + 3il, since the tech- 
niques usually used show that systems sorted into all finite types are conservative 
over a second order system require continuity and U obviously is not continuous. It 
might be possible to adapt the construction of Hunter (Theorem [1} to obtain such 
a conservativity result. 

Towsner asked whether ACAo+3il+"every element of ii is an IP-set" does imply 
ACA([ (Question 4.4). Since this system implies IHT and idempotent ultrafilters 
contain only IP-sets, Theorem [7] reduces this question to the open problem whether 
IHT implies ACAq . Theorem [7] also gives a partial answer to Question 4.6 of [17]. 
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